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ABSTBACT 

The effectiveness of instruction in the use of the 
Program Improvement Project (PIP) model for helping teachers become 
informed classroom decision makers was examined. Subjects were 60 
teacher volunteers from inner-city elementary schools in 
Indianapolis, Indiana. The teachers were exposed to the main concepts 
of the PIP model in six seminar sessions, and the 

pretest/treatment/post- test design was used to evaluate the effects 
of the treatment. A variety of tests were used to measure the 
effects, each test being self-constructed and content validated. Data 
gathered were analyzed statistically using the chi-sguare technique; 
informal evidence also influenced the conclusions. Results showed 
that (1) teachers showed significant gains in making informed 
decisions on a paper and pencil exercise, (2) there was evidence of 
informed decision-making in the actual classroom situation, and (3) 
although the cognitive knowledge of the teachers did not increase 
significantly, there were indications of some cognitive gain from 
chi-square frequencies movement upwards in the quarter categories of 
the 2 by 2 array of data. It was concluded that the PIP model was 
useful as a program improvement guide to help teachers become 
informed decision-makers in the classroom. References are included. 
(VJ) 
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SETTING 

Traditionally, the classroom teacher was not regarded by the 
public or by himself as a decision-maker in school affairs* Recently, 
however, teacherr have voiced demsinds for more pay, more free time, 
and more Involvement in spending school funds. Implicit in each demsind 
was a willingness to accept more responsibility. Spending money was 
one clear example of a process which requires decision-making. 

However, teachers spent more than money. Under the reglus of 
academic freedom, teachers Implemented and thus controlled the entire 
instructional program for individual children. 
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NEED 

The role of the teacher as a decision-maker in the school was 
evident and well recognized. What methods do we have for developing, 
an awareness of this decision-making role in the teacher? Cuba (I969) 
says that creating decision-making awareness is a formidable task in 
itself but vent\ires no clue as to how to do it. A review of several 
of the evaluation models (Stake* Provus* Metfessel-Mlchael* etc.) 
reveals no "how to do it" advice directly aimed at the teacher. 

A "how to do it" guide was needed. One which would lead the 
teacher to an awareness of his role as a classroom decision-maker. But 
more than awareness of decision-making was Involved in producing an 
appropriate guide. A teacher must also be made to understand his role 
as a classroom decision-maker and have some means to achieve the status 
of an Informed decision-maker. He needed a practical method by which 
he could learn the basic concepts of continuous evaluation. He needed 
to apply evaluation concepts to decision-making in the actual classroom 
situation. 

PROBLEM • 

The problem then* was to determine if an evaluation model wxth 
emphasis in decision-making could serve as a guide to Informed class- 
room decision-making for teachers. Next* the Investigator faced a 
choice. He needed to select an appropriate evaluation model. The 
model needed to make the teacher aware of his role as a decision-maker 
^ and make him understand the role* too. The same model must serve as 
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a method by which the teacher could learn continuous evaluation and 
Informed decision-making. Vniat the teacher learned about continuous 
evaluation and Informed decision-making, he must apply In the classroom. 
The terminology of the existing models seemed complex and foreign to 
the reading teachers' everyday world. 

Therefore, the Investigator chose to fashion a model for the 
study which was a close Imitation of an existing evaluation model, but 
which related better to the teachers of reading. The evaluation model 
used In the study was called the PIP model and was modeled after Guba 
and Stufflebeara' s CIPP model.* 

PURPOSE 



The purpose of the study was to explore the effectiveness of 
teaching teachers about decision-making and evaluation. The investiga- 
tor weinted to know ilf teachers would be able to make Informed decisions 
about the learning needs of their children after being exposed to an 
evaluation and declslon-maklng guide. Thr. declslon-maklng and evalua- 
tion content came from the PIP model. The results jf the study Indicated 
whether or not the PIP model served as. a useable guide or "roadmap" to 
Informed declslon-maklng by the classroom teachers. The study sought 
to answer one main question, "VJas Instruction In the use of the PIP 
model useful for helping teachers become Informed classroom decision- 
makers?" 



»(Guba-Stufflebeam, 1968) C~context evaluation, I— Input evaluation, 
P — process evaluation, P — product evaluation 
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POPULATION SAMPLE 

In order to determine if Instruction in the use of the PIP 
model was useful for helping teachers become Informed classroom 
decision-makers, a population of teachers was required. 

The population sample which was selected, consisted of 
Indianapolis elementary teachers. They were sixty teacher volunteers 
from a setting of grade levels one through six. Inner-city, Title I 

funded, Indianapolis Public Schools. 

This study was completed as one aspect of the Program Improve- 
ment Project In Reading conducted In Indianapolis Public School System. 
The project,, a cooperative effort by that school system and a research 
team from Indiana University, School of Education P*-ogram In Reading, 
examined the means for accomplishing continuous program Improvement 
in the school corpv>rat ion's Title I - ESEA reading program. The 
project examined how and where decisions were made concerning the 
Title I reading program and whether a special seminar-training program 
could enable teachers and administrators to make more effective 
program Improvement decisions. 

TREATMENT 



In order to' "treat" the population sample of teachers an 
evaluation model, PIP, was used as the basis for the seminar Instruc- 
tional treatment outline. The teachers were exposed to the main concepts 
of the PIP model In six seminar sessions. The plans for the seminar 
Instructional treatment were Influenced by the content of the PIP model. 
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The actual treatment followed the plans closely. The major headings 
of the six seminars were ; 1. An orientation to PIP and teacher survey, 

2. The learning environment or setting, 3. Objectives and procedures. 
Monitoring and adjusting Instructional activity, 5* Summary evalua- 
tion: fljial results, and 6. A summary of PIP. 

DESIGN 

But how did the Investigator know If the Instructional seminar 
treatment was having any effect on the teachers? He knew by applying 
a pretest/treatment/post-test design In the study. The pretest/treat- 
ment/post-test design contained an evaluation "wrinkle". The design was 
not a "tight" research design because of Its obvious limitations of 
sample and testing Instruments. And, more Important, the design was not 
In the traditional mode because It contained an evaluation emphasis. 

OBJECTIVES AND HYPOTHESES 

To Implement the design. It was necessary for the Investigator 
to state his objectives In two ways. First, the objectives needed to 
be stated in narrative form. After the objectives had been stated In 
narrative form they needed .to be restated In a null hypotheses form, 
so they could be treated In a statistical fashion. The three objectives 
converted Into null hypotheses for clarity In statistical treatment 
follow: 

1. There Is no difference In the pretest scores of the teachers' 
ability for making Informed Instructional decisions on a 
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paper and pencil exercise and the post-test scores of the 
teachers' ability for making Informed Instructional decisions 
on a paper and pencil exercise. 

2. There Is no difference In the pretest scores of the teachers* 
cognitive knowledge about the major concepts of PIP as 
presented In the seminar Instructional treatment and the 
post-test scores of the teachers' cognitive knowledge about 

r 

the major concepts of PIP as presented In the seminar 
Instructional treatment. 

3> There Is no evidence of Informed declslon-maklng In the 
classroom after the seminar Instructional treatment. 

The procedures for studying the stated hypotheses followed the 
pretest/treatment/post-test design. Tha^ Is, there was a pretest 
given for hypotheses one and two, and a post-test given for all three 
hypotheses. The treatment was Instruction In the main concepts of 
the PIP model during six seminar sessions. 

A discussion of the procedural "how" leads Into the procedural 
'■'what". What were the testy used to tap Information about the already 
stated hypotheses? 



TESTS 

There were several tests used to measure whether or not the null 
hypotheses were acceptable. The tests were self-constructed and con- 
tent validated. Here are the names of the tests and where the tests 
were used In the framework of the study. 

ERIC 
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The first hypothesis was checked using self-constructed tests 
called "Aspects of declslon-maklng take home worksheets" for the 
pretest and "Using what you have learned" for the post-test. The 
second hypothesis was checked by using the "Cognitive Knowledge PIP" 
test for both the pretest and post-test. The third hypothesis was 
checked using a classroom observation schedule and an Interview 
technique as a post-test only. The classroom observation schedule 
was constructed originally by Tannenbaum and Cohen and modified by 
Smith and the interview guldesheet was self-constructed. Attitudes 
of the teachers were also considered In the study but not as a formal 
objective. A semantic differential "Attitudes In Your Situation" was 
used to provide Information about the teachers*' attitudes concerning 
assessment and Informed declslon-maklng. 

ANALYSIS 

Once the tests and seminar Instructional treatment were adminis- 
tered, there came the task of analyzing the data. The data for the 
three hypotheses was analyzed statistically by using the chi square 
technique. The method used Is outlined In Hill i Kerber's book. 
Models . Methods . and Analytical Procedure s In Education Research 
(pp. 300 to 305)* Informal evidence also Influenced the conclusions 
of the Investigator. The criteria for making the ultimate research 
decision were these: In the statistical portion of the test there are 

three hypotheses explicated. Two of the three hypotheses must show 
a statistically significant difference between the pretest and the 
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post-test performances. But, hypothesis three, which relate? to the 
actual situation, must be one of the two hypotheses showing a signifi- 
cant difference. 

Movement upward within the distinct categories of the 2x2 array 
of data on the chi square test was considered as evidence of the 
useablllty of the PIP model. However, If the statistical difference 
was NS, the criterion of significance at the .05 level determined the 
decision on that given Hq. 

In the non-statlstlcal portion of the analysis, an Improvement 
In attitude of the participants must be evident. Some positive feed- 
back must be evident from the participants. The feedback was gained 
through seminar evaluation sheets and Informal conversations and a 
"feedback" session during the last meeting of the seminars. The feed- 
back should Indicate that the content of the seminar treatment was 
worthwhile. The teachers needed to be aware that they were decision- 
makers. This Informal evidence was non-quantltatlve for the most part. 
No level, of performance was required. Only an Indication of these 
characteristics was needed. 

These criteria were met and a pos^ive conclusion about the 
main question of the study was made. 

RESEARCH DECISION 



The main question of the study was, "Was Instruction In the. 
use of the PIP model useful for helping teachers become Informed class 
room declslon-maicers?" Yes, Instruction In the use of the PI., model 
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was useful for helping teachers become Informed classroom decision- 
makers. First • the teachers showed significant gains in making Informed 
decisions on a paper and pencil exercise c Second, there was evidence 
of Informed decision-making in the actual classroom situation. Third, 
although the cognitive knowledge of the teachers did not Increase 
significantly, there were indications of some cognitive gain from chi 
square frequencies movement upwards in the quarter categories of the 
2 by 2 array of data. The teachers' overall attitudes toward the 
project Improved and positive Informal feedback was evident. The 
benefit of instruction in the use of the' PIP model was in making some 
teachers aware of themselves as dec id ion-makers in the classroom. 

Overall, the investigator concluded that instruction in using 
the PIP model helped teachers to become Informed classroom decision- 
makers in this setting. The degree to which instruction in using the 
PIP model facilitates Informed classroom decision-making remains an 
open question. The PIP model was useful as a program Improvement 
guide to help teachers become Informed decision-makers in the 
classroom. 
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